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ABSTRACT 


In  an  earlier  report,  a new  method  of  generating 
"skeleton"  representations  of  noisy,  grayscale  pictures 
was  described.  This  supplemental  report  Investigates 
some  variations  on  the  basic  method,  and  also  shows  how 
approximations  to  the  picture  can  be  constructed,  given 
its  "skeleton". 
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1 . The  SPAN 

In  [1],  a general  method  of  constructing  "skeleton" 
representations  of  noisy,  grayscale  pictures  was  developed. 
This  method  assumed  that  a picture  consists  of  a set  of  re- 
gions, each  having  approximately  constant  gray  level 
(possibly  noisy).  The  representation,  referred  to  as  the 
SPAN  (for  Sjpatlal  Piecewise  Approximation  by  Neighborhoods), 
Is  constructed  as  follows: 


1)  At  each  point  of  the  picture,  we  examine  a set  of 
neighborhoods  of  various  sizes.  For  each  neighbor 
hood,  a statistical  test  Is  applied  to  decide 
whether  the  neighborhood  lies  in  a single  region, 
or  overlaps  more  than  one  region.  Let  N(x,y)  be 
the  largest  neighborhood  of  (x,y)  that  lies  in  a 
single  region. 

2)  N(x,y)  is  called  maximal  if  It  is  not  contained  in 
any  other  (larger)  N(u,v).  The  set  of  maximal 
N(x,y)'s  is  called  the  SPAN  of  the  given  picture. 

The  SPAN  is  a generalization,  to  grayscale  pictures,  of 
Blum's  Medial  Axis  Transformation  (MAT);  see  [1]  for  a more 
detailed  comparison.  It  has  several  possible  applications: 

a)  Construction  of  approximations  to  the  picture 

b)  Smoothing  the  picture  (replacing  the  gray  level 
at  each  point  (x,y)  by  the  average  gray  level 
over  N(x,y)) 

c)  Detecting  edges  (at  points  where  two  maximal 
N(x,y)'s  touch) 
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This  report  supplements  [1]  In  several  respects.  It  studies 
alternative  statistical  tests  that  can  be  used  to  choose 
N(x,y)  at  each  point.  It  also  develops  methods  of  reconstruc- 
ting approximations  to  a picture  from  Its  SPAN. 
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2.  Tests  for  neighborhood  acceptance 

The  statistical  test  used  in  [1]  to  determine  whether 
a neighborhood  lies  in  a single  region  was  based  on  construe 
ting  a confidence  Interval  around  the  neighborhood  mean 
within  which  the  true  (region)  mean  should  lie.  If  the 
neighborhood  does  lie  within  a single  region,  this  interval 
should  be  small,  whereas  if  it  overlaps  several  regions,  the 
interval  should  be  large. 

In  this  section  we  Investigate  some  other  methods  of 
deciding  whether  or  not  a neighborhood  lies  in  a single  re- 
gion. One  approach  is  based  on  the  assumption  that  the 
gray  levels  in  each  region  are  normally  distributed;  thus 
our  decision  criterion  can  take  the  form  of  a normality  test 
A second  approach  assumes  that  the  gray  level  distribution 
in  each  region  is  unimodal  , and  takes  the  form  of  a multi- 
modality  test. 

2. 1 Normality  Tests 

A standard  method  of  testing  a distribution  p(z)  for 
normality  is  to  divide  the  z-axls  Into  intervals  correspond- 
ing to  equal  areas  under  the  normal  curve  (having  the  given 
mean  and  standard  deviation).  If  the  observed  population 
Is  close  to  normal.  It  should  be  evenly  distributed  among 
these  Intervals.  A chi-square  test  can  be  used  to  accept 
or  reject  this  hypothesis  at  a given  level  of  confidence. 

The  number  of  Intervals  used  In  this  approach  must  be 
carefully  chosen.  If  there  are  too  few,  the  test  may  be  too 
crude;  but  If  there  are  too  many,  so  that  each  one  contains 


only  a few  samples,  the  distribution  of  samples  among  the 
Intervals  may  be  uneven.  We  have  chosen  to  make  the  number 
of  intervals  proportional  to  the  sample  standard  deviation. 

It  is  also  desirable  to  make  this  number  a divisor  of  the 
sample  size  (here:  the  area  of  the  neighborhood),  to  avoid 

restrictions  on  the  degrees  of  freedom  with  which  a point  can 
go  into  any  given  interval.  The  number  of  intervals  must  be 
larger  than  3,  since  the  degrees  of  freedom  of  the  chi-square 
test  are  reduced  by  3 (because  the  mean,  standard  deviation, 
and  number  of  classes  are  all  known). 

Let  N be  the  number  of  intervals,  and  let  n^  be  the 
observed  number  of  samples  in  the  ith  interval.  If  the  ex- 
pected number  of  samples  in  the  ith  interval  for  a 2k+l  by 
2k+l  neighborhood  is  (2k+l)^/N,  then  we  have 

l [n • - (2k+l )Z/N] 2 
x2  = i =1 

( 2k+l ) 2/N 

Depending  on  the  number  of  intervals  used,  we  accept  or  re- 
ject the  hypothesis  that  the  neighborhood  has  a normal  d 1 s - 

2 

tribution  according  to  whether  the  value  of  x is  less  or 
greater  than  the  critical  value  at  the  desired  confidence 
1 evel . 

In  our  experiments,  the  sample  (s  neighborhood)  sizes 
2 

used  were  (2k+l)  for  k * 1,...,5,  and  the  confidence  level 
used  for  rejecting  normality  was  95%.  The  number  of  in- 
tervals used  was  taken  to  be  1.8o;  this  was  rounded  down 
to  the  nearest  divisor  of  the  neighborhood  size.  For  k=1 , 
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since  the  sample  size  was  quite  small,  a confidence  level  of 
80%,  rather  than  95%,  was  used.  If  the  normality  hypothesis 
was  rejected  even  for  k=l , the  default  decision  was  k=0, 
l.e.,  N(x,y)  was  taken  to  be  { ( x ,y ) } itself. 

A supplementary  test  for  normality  was  based  on  the 
skewness  of  the  sample  distribution.  The  skewness  coefficient 
/E  for  a sample  (x^'s)  with  mean  x is 

Itx1-x)3/{2k+1 )2  I(x,-I)3.(2k+1) 

^ ’ a(xr*)2]3/2 

A neighborhood  survives  the  skewness  test  if  its  /IT  is  below 
the  critical  value  for  the  desired  degree  of  confidence  (we 
used  95%). 

2 

The  skewness  and  x tests  provide  complementary  informa- 
tion about  possible  non-normality  of  the  sample  distribution. 
For  example,  a neighborhood  just  on  the  border  between  two 
regions  having  the  same  variance  would  have  a symmetrical 
distribution  that  would  pass  the  skewness  test,  but  that 

o 

should  be  rejected  by  the  x test.  On  the  other  hand,  a 

neighboorhood  that  protrudes  slightly  across  a region  border 

2 

might  pass  the  x test,  but  would  have  an  asymmetrical  dis- 
tribution that  should  be  rejected  by  the  skewness  test.  We 
required  that  both  tests  be  passed  In  order  to  accept  a 
neighborhood. 

Figure  1 shows  the  original  Images  (noise-free  and 
noisy);  the  value  of  N(x,y)  at  each  point  (k=0,  1,...,5 
represented  by  gray  levels  10,  20,. ..,60);  the  values  of  the 
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maximal  N(x,y)'s,  with  nonmaxima  set  to  zero;  the  edges  at 
which  pairs  of  maximal  N(x,y)'s  meet;  and  the  results  of  smooth- 
ing the  images  by  replacing  the  gray  level  at  each  point  (x,y) 
by  the  average  gray^level  over  the  neighborhood  N(x,y).  These 
results  are  analogot&o  those  in  Figures  4,  5,  7,  and  9 of 
[1];  the  original  images  are  the  same  as  those  in  Figure  1 of 
[1].  It  can  be  seen  that 

a)  The  skeletons  ( = sets  of  centers  of  maximal  N(x,y)'s) 
are  now  much  thinner,  since  a larger  set  of  radii  is 
being  used  ([1]  allowed  only  k = 0,  1,  2) 

b)  Otherwi^.  the  quality  of  the  results  is  about  the 
same  as  in  [1]. 

2 . 2 Multimodality  test 

A much  simpler  approach  to  neighborhood  acceptance  is  to 
test  the  distribution  of  gray  levels  in  the  neighborhood  for 
multimodality.  A neighborhood  contained  within  a single  re- 
gion should  have  a unimodal  distribution;  thus  if  the  dis- 
tribution is  found  to  be  multimodal,  we  can  assume  that  it 
does  not  lie  in  one  region. 

To  test  for  multimodality,  we  first  smoothed  the 
neighborhood's  gray  lev*1  histogram  by  averaging  over  a 5- 
gray-level  nei ghborhooV of  each  histogram  point.  In  the  re- 
sulting smoothed  histogram,  changes  in  the  sign  of  the  slope 
that  persisted  for  three  or  more  successive  points  were 
counted.  Each  such  change  from  positive  to  negative  repre- 
sents a peak.  A histogram  with  two  or  more  peaks  was  taken 
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to  be  multimodal . 

Figure  2 Is  analogous  to  Figure  1.  but  using  the  multi- 
modality  test.  The  skeletons  and  edges  tend  to  be  somewhat 
thinner  and  sharper  than  those  In  Figure  1,  but  there  are 
more  gaps.  The  smoothings  of  the  noisy  Images  are  somewhat 
noisier.  However,  the  overall  performance  Is  quite  comparable 
to  that  using  the  more  complex  normality  tests. 
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3.  Image  reconstruction  from  the  SPAN 

One  of  the  useful  properties  of  Blum's  MAT  is  that  it 
can  be  used  to  reconstruct  the  original  image  subset,  since 
this  is  just  the  union  of  the  maximal  neighborhoods  in  the 
MAT.  More  important,  if  neighborhoods  of  small  sizes  are 
omitted  from  the  MAT,  the  reconstruction  yields  a simplified 
version  of  the  original  subset,  with  small  parts  deleted  but 
major  parts  (approximately)  preserved.  This  section  addresses 
the  correspondi ng  problem  of  reconstructing  an  approximation 
to  the  original  image  from  the  SPAN. 

The  natural  building  blocks  for  such  a reconstruction 
are  the  maximal  neighborhoods  N(x,y),  each  filled  in  with  a 
constant  gray  level  equal  to  its  average  gray  level  on  the 
original  image.  However,  it  is  not  clear  how  these  N(x,y)'s 
should  be  combined  when  they  overlap  (and  have  different 
gray  levels).  We  have  chosen,  somewhat  arbitrarily,  to  use 
the  following  rules  of  combination: 

1)  When  maximal  N(x,y)'s  having  the  same  radius  overlap, 
we  use  the  maximum  of  their  gray  levels.  [Alterna- 
tives would  be  to  use  the  minimum,  or  the  average; 
all  of  these  alternatives  will  be  illustrated  below.] 

2)  When  maximal  N(x,y)'s  having  different  radii  over- 

lap, we  use  the  gray  level  belonging  to  the  one  with 
the  smaller  radius.  [Rationale:  The  ones  with 

small  radii  are  needed  to  provide  fine  image  detail; 
they  could  not  do  this  if  they  were  overidden  by  the 
large  ones.  Indeed,  the  large  ones  will  pass  the 
acceptance  tests  even  when  they  slightly  overlap 


neighboring  regions,  and  this  could  cause  the  mean 
gray  level  of  one  region  to  be  given  to  points  of 
an  adjacent  region.] 
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Figure  3 shows  steps  in  the  reconstruction  cf  the  images 
of  Figures  1-2  (both  noisy  and  non-nolsy)  using  these  rules 
of  combination.  We  first  display  the  N(x,y)'s  having  each 
individual  radius  (k  = 5,  4,  3,  2,  1,  0),  and  then  display 
the  cumulative  effects  of  combining  the  N(x,y)'s  having 
different  radii,  beginning  with  the  largest  radius 
(5+4;  5+4+3;  5+4+3+2;  5+4+3+2  + 1 ; 5+4+3+2+1 +0 ) . It  is  seen 
that 

a)  The  reconstruction  of  the  non-noisy  images  resemble 
the  original  images  closely. 

b)  The  reconstructions  of  the  noisy  images  resemble 

the  originals  crudely,  but  have  a mottled  appearance. 

This  is  primarily  caused  by  the  3-by-3  N(x,y)'s  (k=l), 
for  which  an  over-tol erant  80%  confidence  level  was  used. 

c)  The  smallest  size  (k=0)  contributes  almost  nothing 
to  the  reconstruction. 

The  N(x,y)'s  obtained  using  the  normality  tests  were  used  in 
this  Figure. 

The  results  are  similar  if  we  use  N(x,y)'s  obtained 
from  the  multimodality  test,  or  if  we  use  the  average  or 
min,  rather  than  the  max,  in  combining  the  N(x,y)  gray 
levels.  Final  reconstructions  ( 5+4+3+2+1+0)  for  all  of 
these  cases  are  shown  in  Figure  4.  We  see  that 
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a)  The  results  using  max,  min,  and  average  are  all 
quite  similar. 

b)  The  results  based  on  the  multimodality  test  are 
sharper,  but  more  blocky,  than  those  based  on  the 
normality  tests.  Apparently  this  test  accepted  too 
many  5-by-5  neighborhoods  and  too  few  3-by-3's. 

A more  quantitative  comparison  of  these  results  can  be 
made  with  reference  to  Figures  5 and  6.  Figure  5 tabulates 
the  number  of  maximal  N(x,y)'s  of  each  radius,  for  each  of 
the  ten  input  pictures,  based  on  both  the  normality  and 
multimodality  tests.  It  is  seen  that  the  multimodality 
test  yields  substantially  fewer  SPAN  points  than  the  nor- 
mality tests. 

Figure  6 tabulates  the  mean  absolute  reconstruction 
errors  for  each  of  the  ten  input  pictures,  using  the  two 
types  of  N(x,y)'s  (based  on  normality  and  mul ti moda 1 i ty ) 
and  the  three  combination  rules  (max,  min,  average).  It  is 
seen  that 

a)  These  errors  only  amount  to  a few  gray  levels 
(on  a gray  scale  of  0-63). 

b)  The  errors  are  generally  smaller  for  the  multi- 
modality test  than  for  the  normality  test,  in 
spite  of  the  latter's  involving  more  SPAN  points. 

c)  For  a given  test,  the  average,  min,  and  max  re- 
construction schemes  do  about  equally  well.  (The 
average  does  noticeably  better  for  the  normality 
test  in  the  case  of  the  chromosome  image,  perhaps 
because  its  edges  are  so  blurred.) 
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4.  Compression  based  on  the  SPAN 

If  the  pictures  reconstructed  from  the  SPAN  are  accept- 
able approximations  to  the  original  pictures,  the  SPAN  can 
be  used  as  the  basis  for  a picture  compression  scheme.  In 
fact,  suppose  that  we  encode  the  picture  points  as  follows: 

0 - nonSPAN  point 

lag  - SPAN  point  having  radius  a and  mean  gray  level  8 
in  its  maximal  neighborhood. 

Here  a is  a 3-bit  number  (the  possible  radii  are  0,  1,...,5), 
and  8 is  a 6-bit  number  (assuming  that  we  round  the  average 
gray  levels  to  the  nearest  integer  in  the  original  range 
0,...,63).  Thus  the  lag  codes  have  ten  bits  each  (1+3+6). 

If  the  fraction  of  SPAN  points  in  the  picture  is  p,  and  the 
picture  has  N points,  then  the  number  of  bits  required  to 
encode  the  picture  in  this  way  is 

1 OpN  + (l-p)N  = ( 1 +9p)N 

On  the  other  hand,  if  we  simply  encoded  each  picture  point 
by  its  gray  level  (a  6-bit  number),  the  picture  would  re- 
quire 6N  bits.  Using  the  SPAN  encoding  is  thus  more 
economical  provided  1 +9 p < 6,  i.e.,  provided  p < 5/9. 

As  an  example,  consider  the  first  of  our  ten  pictures, 
for  which  the  SPAN  constructed  using  the  normality  test 
h*j  337  (out  of  N * 1024)  points,  while  the  SPAN  based  on 
the  multimodality  test  has  only  231  points.  Here  encoding 
each  picture  point  by  its  gray  level  would  require 
6 x 1024  * 6144  bits.  When  the  SPAN  Is  used,  however,  the 
numbers  of  bits  needed  is 
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10  x 337  + (1024-337)  = 3370  + 687  = 4057 


and  10  x 231  + (1024-231)  = 2310  + 783  * 3103 

for  the  normality  and  multimodality  approaches,  respectively; 
the  latter  represents  a compression  of  nearly  2:1.  The  re- 
sults are  similarfor  the  remaining  nine  pictures,  both 
noisy  and  non-noisy. 

[If  there  were  very  few  SPAN  points,  an  alternative 
method  of  encoding  would  be  to  simply  list  the  radii,  gray 
levels,  and  coordinates  of  these  points.  In  our  cases, 
where  the  pictures  are  32  by  32  (or  smaller),  the  coordinates 
would  require  10  bits  (5  each  for  row  number  and  column 
number),  which  together  with  the  9 bits  for  gray  level  and 
radius  comes  to  19  bits  per  SPAN  point.  If  there  were  (say) 
only  100  SPAN  points,  this  would  require  1900  bits  total, 
for  a compression  of  over  3:1;  but  for  200  or  more  SPAN 
points  it  requires  3800  or  more  bits,  which  is  more  than 
were  needed  using  the  method  described  above.] 
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5.  The  SPAN  as  a segmentation  aid 


It  is  well  known  that  a picture  can  often  be  segmented 
by  detecting  valleys  In  Its  gray  level  histogram,  and 
choosing  thresholds  at  the  bottoms  of  these  valleys.  The 
SPAN  approach  can  be  used  to  make  histogram  valleys  easier 
to  detect.  This  Is  Illustrated  In  Figure  7,  which  shows 
gray  level  hi stograms for  the  six  original  non-artificial  pic- 
tures; the  smoothed  pictures  (see  Figure  1)  using  N(x,y)'s 
determined  by  both  the  normality  and  mul timodal 1 ty  tests;  and 
the  reconstructed  pictures  (see  Figure  4)  using  SPAN  points 
chosen  by  both  tests,  and  the  max  rule  for  combining  gray 
levels . 

It  Is  seen  that  the  smoothed  pictures  have  sharper- 
peaked  histograms  than  the  original  pictures,  while  the 
histograms  of  the  reconstructed  pictures  are  sharper  still. 
Thus  smoothing  using  the  N(x,y)  neighborhoods,  and  recon- 
struction using  the  maximal  N(x,y)'s,  tends  to  yield  histo- 
grams that  should  be  easier  to  segment. 
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Results  of  neighborhood  selection 
using  normality  tests: 

Original  Image;  (2)  N(x,y)  radii; 
maximal  N(x,y)  radii;  (4)  edges; 
smoothed  Images.  Images  (a-e)  ar 
noise-free,  (f-j)  are  noisy. 
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( 1 ) max 


Figure  4.  Reconstructions  (5+4+3+2+1+0;  see 

Figure  3)  based  on  N(x,y)'s  obtained 
from  (A)  normality  and  (B)  multimodality 
tests,  using  (1)  max,  (2)  min,  and  (3) 
average  for  combining  gray  levels. 
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gure  7.  Histograms:  (1)  original;  (2)  smoothed,  using  normality  test 

constructed,  using  normality  test  and  max  rule;  (4)  smoothed, 
modality  test;  (5)  reconstructed,  using  multimodality  test  an 
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